J. 



t 



WORLD INTELLECTUAL PROPERTY ORGANIZATION 
International Bureau 




per 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification 5 : 




(11) International Publication Number: 


WO 94/10816 


H04R 5/00 


Al 


(43) International Publication Date: 


1 1 May 1994(11.05.94) 



(21) International Application Number: PCT/US93/01 840 

(22) International Filing Date: 1 March 1993 (01.03.93) 



(30) Priority data: 

07/968,562 



29 October 1 992 (29. 1 0.92) US 



(71) Applicant: WISCONSIN ALUMNI RESEARCH FOUN- 

DATION [US/US]; P.O. Box 7365, Madison, WI 
53707-7365 (US). 

(72) Inventors: CHEN, Jiashu ; 509G Eagle Heights, Madison, 

WI 53705 (US). VAN VEEN, Barry, D. ; 6109 Forest 
Ridge Court, McFarland, WI 53558 (US). HECOX, 
Kurt, E. ; 1011 Grant Street, Madison, WI 53711 (US). 



(74) Agents: McGOVERN, Michael, J. et al.; Quarles & Brady, 
41 1 East Wisconsin Avenue, Milwaukee, WI 53202-4497 
(US). 



(81) Designated States: CA, JP, European patent (AT, BE, CH, 
DE, DK, ES, FR, GB, GR, IE, IT, LU, MC, NL, PT, 
SE). 



Published 

With international search report. 



(54) Title: METHODS AND APPARATUS FOR PRODUCING DIRECTIONAL SOUND 



(57) Abstract 



Free-field-to-eardrum transfer functions 
(FETFs) are developed by comparing auditory da- 
ta for points in three-dimensional space for a mod- 
el ear and auditory data collected for the same lis- 
tening location with a microphone. Each FETF is 
represented as a weighted sum of frequency-de- 
pendent functions obtained from an expansion of 
the measured FETF's covariance matrix. Spatial 
transformation characteristic functions (STCF's) 
are applied to transform the weighted frequency- 
dependent factors to functions of spatial variables 
for azimuth and elevation. A generalized spline 
model is fit to each STCF to filter out noise and 
permit interpolation of the STCF between mea- 
sured points. Sound is reproduced for a selected di- 
rection by synthesizing the weighted frequency-de- 
pendent factors with the smoothed and interpolat- 
ed STCF's. 
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1. Field of the Invention 

The field of the invention is methods and apparatus 
for detecting and reproducing sound. 

2. Description of the Background Art 

Extensive physical and behavioral studies have re- 
vealed that the external ear (including torso, head, 
pinna, and canal) plays an important role in spatial hear- 
ing. It is known that, external ear modifies the spectrum 
of incoming sound according to incidence angle of that 
sound. It is further known that in the context of binau- 
ral hearing, the spectral difference created by the exter- 
nal ears introduces important cues for localizing sounds 
in addition to interaural time and intensity differences. 
When the sound source is within the sagittal plane, or in 
the case of monaural hearing, the spectral cues provided 
by the external ear are utilized almost exclusively by the 
auditory system to identify the location of the sound 
source. The external ears also externalize the sound im- 
age. Sounds presented binaurally with the original time 
and intensity differences but without the spectral cues 
introduced by the external ear are typically perceived as 
originating inside the listener's head. 

Functional models of the external ear transformation 
characteristics are of great interest for simulating real- 
istic auditory images over headphones. The problem of re- 
producing sound as it would be heard in three-dimensional 
space occurs in hearing research/ high fidelity music re- 
production, and voice communication. 

Kistler and Wightman describe a methodology based on 
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free-field-to-eardrum transfer functions (FETF's) in a pa- 
per published in the Journal of the Acoustical Society of 
America (March, 1992) pp. 1637-1647. This methodology an- 
alyzes the amplitude spectrum and the results represent up 
5 to 90% of the energy in the measured FETF amplitude. This 
methodology does not provide for interpolation of the 
FETF 1 s between measured points in the spherical auditory 
space around the listener's head, or represent the FETF 
phase . 

10 For further background art in the relevant area of 

auditory research, reference is made to the Introduction 
portion of our article, "External Ear Transfer Function 
Modeling: A Beamforming Approach", published in the Jour- 
nal of the Acoustical Society of America, vol. 92, no. 4, 

15 Pt. 1 (October 30, 1992) pages 1933-1944. 

Summary of the invention 

The invention is incorporated in methods and appara- 
tus for recording and playback of sound, and sound record- 
ings, in which a non-directional sound is processed for 

20 hearing as a directional sound 

Using measured data, a model of the external ear 
transfer function is derived, in which frequency depen- 
dance is separated from spatial dependance. A plurality 
of frequency-dependent functions are weighted and summed 

25 to represent the external ear transfer function. The 
weights are made a function of direction. Sounds that 
carry no directional cues are perceived as though they are 
coming from a specific direction when processed according 
to the signal processing techniques disclosed and claimed 

30 herein. 

With the invention, auditory information takes on a 
spatial three-dimensional character. The methods and ap- 
paratus of the invention can be applied when a listener, 
such as a pilot, astronaut or sonar operator needs direc- 
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tional information, or they can be used to enhance the 
pleasurable effects of listening to recorded music. 

Other objects and advantages, besides those discussed 
above, shall be apparent to those of ordinary skill in the 
5 art from the description of the preferred embodiment which 
follows. In the description, reference is made to the ac- 
companying drawings, which form a part hereof, and which 
illustrate examples of the invention. Such examples, how- 
ever, are not exhaustive of the various embodiments of the 
10 invention, and therefore reference is made to the claims 
which follow the description for determining the scope of 
the invention. 

Brief Description of the Drawings 

Fig. 1 is a diagram showing how sound data is col- 
15 lected according to the present invention; 

Figs. 2a-2j are spectral graphs of sound collected in 
Fig. 1 or interpolated relative to data collected in Fig. 
1; 

Fig. 3 is a block diagram of the apparatus used to 
20 record sound data as depicted in Figs. 1 and 2; 

Fig. 4 is a flow chart showing the steps in producing 
a sound according to the present invention; 

Fig. 5a is a functional circuit diagram showing how a 
directional sound is synthesized with the apparatus of 
25 Fig. 6; 

Fig. 5b is a functional circuit diagram showing a 
second method for synthesizing sound with the apparatus of 
Fig . 6 ; and 

Fig. 6 is a block diagram showing apparatus for pro- 
3 0 ducing a directional sound according to the present inven- 
tion. 
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Detailed Dfi.grrinMon of the P referred Embodiments 

Referring to Fig. 1/ the invention utilizes data mea- 
sured in three-dimensional space relative to a typical hu- 
man ear. The measurements may be conducted on a human 
5 subject, if a specific subject ear is required, or with a 
special manikin head 10, such as a KEMAR™ head, which rep- 
resents a typical human ear. The spherical space around 
the head is described in terms of spherical coordinates G 
and <P. The variable 8 represents azimuth angle readings 

10 relative to a vertical midline plane defined by axes 11 
and 12 between the two ears (with angles to the right of 
the midline plane in Fig. .1 being positive angles and with 
angles to the left being negative angles) . The variable 9 
represents elevation readings relative to a horizontal 

15 plane passing through the axes 12 and 13 and the center of 
the ears (above this plane being a positive angle and be- 
low this plane being a negative angle) . Isoazimuth and 
isoelevation lines 14 are shown in 20° increments in Fig. 
1. A speaker 15 is moved to various positions and gener- 

20 ates a broadband sound. 

The ear sound is measured using the subject's ear or 
manikin's head 10 by placing a microphone in one ear to 
record sound as it would be heard by a listener. Data can 
be taken for both ears. To develop a free-field-to-ear 

25 transfer function, sound is also measured without the ef- 
fects of the ear, by removing the subject's ear or 
manikin's head 10 and detecting sound at the ear's previ- 
ous location. This is "free field" sound data. Both mea- 
surements are repeated for various speaker locations. 

3 0 Standard signal processing methods are used to determine 
the transfer function between the ear and the free- field 
data at each location. 

Figs. 2a, 2c, 2e, 2g and 2i shows a series of spec- 
tral sound graphs (amplitude vs. frequency) for a series 
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of readings for 18.5° elevation, and varying azimuth an- 
gles from 0° to 3 6°. The readings were taken at 9° inter- 
vals. A shift in spectral peaks and valleys is observed 
as the origin of the sound is moved. Figs. 2b, 2d, 2f, 2h 
5 and 2j show values which have been interpolated using the 
data and methodology described herein. 

Fig. 3 illustrates the apparatus for collecting sound 
data for free-field and ear canal recording. The subject 
10 and a movable speaker 15 are placed in a chamber 16 for 

10 sound recording. A personal computer 20, such as the IBM 
PC AT or an AT-compatible computer, includes a bulk memory 
21, such as a CD-ROM or one or more large capacity hard 
drives. Microphones 23a, 23b are placed in the subject '.s 
or manikin's ears. The sound is processed through an am- 

15 plifier and equalizer unit 24 external to the computer. 20 
and analog band pass filtering circuitry 27 to an A-to-D 
converter portion 22a of a signal processing board in the 
computer chassis. There, the analog signals of the type 
seen in Fig. 2 are converted to a plurality of sampled, 

20 digitized readings. Readings are taken at as many as 2000 
or more locations on the sphere around the manikin head 
10. This may require data storage capacity on the order 
of 70 Megabytes. 

The computer 20 generates the test sound through a* 

25 sound generator portion 22b of the signal processing 

board. The electrical signal is processed through power 
amplifier circuitry 25 and attenuator circuitry 26 to 
raise the generated sound to the proper power level. The 
sound-generating signal, which is typically a square wave 

30 pulse of 30-100 microseconds in duration or other broad- 
band signal in duration is then applied through the 
speaker 15 to generate the test sound. The speaker 15 is 
moved from point to point as shown in Fig. 1. 

In an alternative embodiment for recording spatial. 

35 sound data, a VAX 3200 computer is used with an ADQ-32 
signal processing board. 
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in methods and apparatus for recording and playing . 
back simulated directional sound, an audio input signal is 
passed through a filter whose frequency response models 
the free field-to-eardrum transfer function. This filter 
is obtained as a weighted combination of basic filters 
where the weights are a function of the selected spatial 
direction. 

Fig. 4 illustrates how sound data collected in Figs. 
1-3 is processed to determine the basic filters and 
weights used to impart spatial characteristics to sound 
according to the present invention. The sound data has 
been input and stored for a plurality of specific speaker 
locations, as many as 2000 -or more, for both free field, 
R(co, 6, <P) , and ear canal recording, E(co, 6, <P) . This is 
represented by input block 31 in Fig. 4. This data typi- 
cally contains noise, measurement errors and artifacts 
from the detection of sound. Conventional, known signal 
processing techniques are used to develop a free-field-to- 
ear transfer function H (to, 6, <P) , as represented by pro- 
cess block 32 in Fig. 4, which is a function of frequency 
co, at some azimuth & and some elevation 9. This block 32 
is executed by a program written in MATLAB and C program- 
ming language running on a SUN/ SPARC 2 computer. MATLAB™, 
version 3.5, is available from the Math Works, Inc., Nat- 
ick, MA. A similar program could be written for the AT- 
compatible computer 20 or other computers to execute this 
block. 

If H (CO, 9, <P) is the measured FETF at some azimuth 6 
and elevation 9, the overall model response, H (co, 0, S>) , 
can be expressed as the following equation: 



Note that the model separates frequency-dependence charac- 
terized by the basic filters, represented by tj.(co)(i = 0, 



H (co, 9, <p) = .£ ti (co) Wi (0, cp) + to (co) 



(1) 
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1,..., p) , also referred to as eigenfilters (EF's), from 
the spatial-dependence represented by weights, w^e, <P) (i 

= l,...,p). These weights are termed spatial transforma- 
tion characteristic functions (STCF's). This provides a 
two-step procedure for determining H (CO, 9, ( P) for live 

recordings provided that the above equation can be solved 
for ti«D) and Wi(9, <P) . 

The present invention provides the methods and appa- 
ratus to determine EF's and STCF's, so that the model re- 
sponse H (CO, 0, <P) is a good approximation to H (co, 9, 9) . 

Let H(6, <P) and ti be N dimensional vectors whose el- 
ements are N samples in frequency of the measured FETF's, 
H (co, 9, <P) , and N samples in frequency of the eigenfil- 
ters {ti(co), i = 0,1,..., p}. The value for N is typically 
256 although larger or smaller values could also be used. 
N should be sufficiently large so that the eigenfilters 
are well described by the samples of ti. The eigenfilters 
{ti(co), i = l,2,...,p} are chosen as eigenvectors corre- 
sponding to the p largest eigenvalues of a sample covari- 
ance matrix Z H formed from the spatial samples of the FETF 
frequency vectors H(9, <P) . The eigenfilter t 0 (co) is chosen 

as the sample mean jj formed from the spatial samples of 

FETF frequency vectors H(9, <P) . if H(0j, <P k ) represents 
the measured FETF at the azimuth elevation pair (9j, 9^) 

and providing that j = 1,..., L, k = 1,..., M, where LxM 
is on the order of 2000, the covariance matrix E H of FETF 
samples is given by 

EH = U^^= lZ ^= ia i k(H ( e j.^)- R) ( H ( e j. ( ^)- H ) H (2 ) 

where h » the sample mean, is expressed as follows: 

In equation (2) the superscript "H" denotes a complex 
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conjugate transpose operation. The non-negative weighting 
factor otjk is used to emphasize the relative accuracy of 
this analysis in some directions more than others. If all 
directions are equally important, otjk = 1,. for j = 1,..., 

5 L, k = 1, . . . i M. 

The EF frequency vectors {ti(CD) (i = 1, 2,..., p) } 

satisfy the following eigenvalue problem 

Z H ti = Xi ti (4) 

where i = 1, P and where Xi are the "p" largest 

10 eigenvalues of 1^. The fidelity of sound reproduced using 
the methodology of the invention is improved by increasing 
M P" . A typical value for ,"p" is 16. The EF vector, to (co) 

is set equal to jj . 

The STCF's witB,?), i = .1 p/ are obtained by fit- 

15 ting a spline function over azimuth and elevation vari- 
ables to STCF samples, wj^Gj,^) , i = 1,.... ,p, j = 1 ' 
L, k = 1, . . . , M, which are chosen to minimize the squared 
error between the calculated values and measured values of 
FETF's at locations (Gj,<P k ) j = 1, L, k = 1 M. 

20 The samples wiOj,^) that minimize the squared error are 

given by 

wi(e-,,<Pk> = t±H H(ej,9 k ) (5) 

where i = l,...,p, j =1, . N, k = 1, . M. 
Here we assume without loss of generality that the ti has 
25 a unit norm, that is, ti H ti = 1, i = l,...,p. 

The spline model for generating the STCF's smooths 
measurement noise and enables interpolation of the STCF's 
(and hence the FETF's) between measurement directions. 
The spline model is obtained by solving the regularization 
3 0 problem 

min i Z ( wft ,<p k ) - w^j ,cp k )) 2 + * I Pwi(0. <P> f 

Wi(a <p) i=i k=l v ^ J 7 ( 6 ) 
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where i = 1, . . . ,p. Here Wj(6j,<p k ) is the functional repre- 
sentation of the ith STCF, X is the regular ization parame- 
ter, and P is a smoothing operator. 

The regularization parameter controls the trade-off 
5 between the smoothness of the solution and its fidelity to 
the data. The optimal value of A, is determined by the 
method of generalization cross validation. Viewing 9 and 
*P as coordinates in a two dimensional rectangular coordi- 
nate system, the smoothing operator P is 



|Pwj{e,(p)| 2 = 



d6d<p< 

Jr ^ 


a 2 w(e,<p) 


2 

+ 2 


a 2 w(M 


2 


'a 2 w(e.<p)" 


ae 2 


aea<p 


+ 


acp 2 



The regularized STCF ' s are combined with the EF's to syn- 
thesize regularized FETF ' s at any given 9 and <P. 

Process block 33 in Fig. 4 represents the calculation 
of Z H / which is performed by a program in the MATLAB™ lan- 

15 guage running on the SUN/ SPARC 2 computer. A similar 

program could be written for the AT-compatible computer 20 
or another computer to execute this block. 

Next, as represented by process block 3 4 in Fig. 4, 
an eigenvector expansion is applied to the S H results to 

20 calculate the eigenvalues, X±, and eigenvectors which 
correspond to the weighted functions of frequency ti(co). 
In this example, the eigenanalysis is more specifically 
referred to as the Karhunen-Loeve expansion. For further 
explanation of this expansion, reference is made to Pa- 

25 poulis, Probability, Random Variables and Stocha stic Pro- 
cesses . 3d ed. McGraw-Hill, Inc., New York, NY,. 1991, pp. 
413 — 416, 425. The eigenvectors, are then processed, as 
represented by block 3 5 in Fig. 4, to calculate the sam- 
ples of the STCF's, wi as a function of spatial variables 

30 (9, 9) for each direction from which the sound has been 

measured, as described in equation 5 above. This calcula- 
tion is performed by a program in the MATLAB™ language 
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running on the SUN /SPARC computer. A similar program 
could be written for the AT -compatible computer 20 or a 
different computer to execute this block. 

Next, as represented by process block 3 6 in Fig. 4, a 
generalized spline model is fit to the STCF samples using 
a publicly available software package known as RKpack, ob- 
tained through E-mail at netlib@Research.att.com.. The 
spline model filters out noise from each of the sampled 
STCF's. The spline-based STCF's are now continuous func- 
tions of the spatial variables (9, <P) . 

The surface mapping and filtering provides resulting 
data which permits interpolation of the STCF's between 
measured points in spherical space. The EF's to (CO) and 
ti(co), and the STCF's, wi(9, <P) , i = l, . .., p, describe the 
completed FETF model as represented in process block 37. 
An FETF for a selected direction is then synthesized by 
weighting and summing the EF's with the smoothed and in- 
terpolated STCF's. A directional sound is synthesized by 
filtering a non-directional sound with the FETF as repre- 
sented by process block 38. 

The synthesized sound is converted to an audio sig- 
nal, as represented by process block 39, and converted to 
sound through a speaker, as represented by output block 
40. This completes the method as represented by block 41, 

Fig. 5a is a block diagram showing how a directional 
sound is synthesized according to the present invention. 
A non-directional sound represented by input signal 29 in 
Fig. 5 is played back through a variable number, p, of 
filters 42 corresponding to a variable number, p, of EF's 
for the right ear and a variable number, p, of filters 43 
for the left ear. In this embodiment p = 16 is assumed 
for illustrative purposes. The signal coming through each 
of these sixteen filters 42 is amplified according to the 
SCTF analysis of data, represented by blocks 106, 107 as a 
function of spatial variables G and 9, as outlined above, 

for each ear as represented by sixteen multiplying junc- 
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tions 7 4 for the right ear and sixteen multiplying junc- 
tions 75 for the left ear. The input signal 29 is also 
filtered by the FETF sample mean value, to (co), represented 

by blocks 51, 52 in Fig* 5a, and then amplified by a fac- 
5 tor of unity (1) . The amplified and EF filtered component 
signals are then summed with each other and with the zero- 
frequency components 51, 52 at summing junctions 80 and 
81, for right and left ears, respectively, and played back 
through headphones to a listener in a remote location. By 

10 weighting the EF filtered signals with the STCF weights 
corresponding to a selected direction defined by 8 and 9, 
and summing the weighted filtered signals, a sound was 
produced with the effect that the sound was originating 
from the selected direction. 

15 Fig. 5b shows an alternative approach to synthesize 

directional sound according to the present invention. 
Here the non-directional input signal 29 is filtered di-" 
rectly by the FETF for the selected direction. The FETF 
for the selected direction is obtained by weighting the 

20 EF's 55, 56 at "p" multiplying junctions 45, 46 with the 
STCF's 106, 107 for the selected direction. Then, the ad- 
justed EF 1 s are summed at summing junctions 47, 48, to- 
gether with the FETF sample mean value, to (CO) , represented 
by elements 55, 56, to provide a single filter 49, 50 for 

25 each respective ear with a response characteristic for the 
selected direction of the sound. 

In the above examples, the filtering of components is 
performed in the frequency domain, but it should be appar- 
ent that equivalent examples could be set up to filter 

30 components in the time domain, without departing from the 
scope of the invention. 

Both Figs. 5a and 5b show a final stage which ac- 
counts for the interaural time delay. Since the interau- 
ral time delay was removed during the process of the mod- 

3 5 eling, it needs to be restored in the binaural implementa- 
tion. The interaural time dely ranges from 0 to about 
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700ns. The. blocks 132 and 142 in Figs. 5a and 5b, respec- 
tively, represent interaural time delay controllers. They 
convert the given location variables G and <P into time de- 
lay control signals and send these control signals to both 
ear channels. The blocks 130, 131, 140 and 141 are delays 
controlled by the interaural time delay controllers 132, 
142. The actual interaural time delay can be calculated 
by cross-correlating the two ear canal recordings vs. each 
sound source location. These discrete interaural time de- 
lay samples are then input into the spline model, thus a 
continuous interaural time delay function is acquired. 

Fig. 6 is a block diagram showing apparatus for pro- 
ducing the directional sound according to the present in- 
vention. The non-directional sound is recorded using a 
15 microphone 82 to detect the sound and an amplifier 83 and 
signal processing board 84-86 to digitize and record the 
sound. ■ The signal processing board includes data acquisi- 
tion circuitry 84, including analog-to-digital converters, 
a digital signal processor 85, and digital-to-analog out- 
put circuitry 86. The signal processor 85 and other sec- 
tions 84, 86 are interfaced to the PC AT computer 20 or 
equivalent computer as described earlier. The digital-to- 
analog output circuitry 86 is connected to a stereo ampli- 
fier 87 and stereo headphones 88. The measured data for 
the FETF is stored in mass storage (not shown) associated 
with the computer 20. Element 89 illustrates an alterna- 
tive in which an audio signal is prerecorded, stored and 
then fed to. the digital signal processor 85 for production 
of directional sound. 

The signal 29 in Figs. 5a and 5b is received through 
microphone 82. The filtering by filters 42 and 43, and 
other operations seen in Fig. 5a and 5b, are performed in 
the digital signal processor 85 using EF's and STCF func- 
tion data 106, 107 received from the AT-compatible com- 
35 puter 20 or other suitable computer. 

The other elements 86-88 in Fig. 6 convert the audio 
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signals seen Fig. 5 to sound which the listener observes 
as originating from the direction determined by selection 
of 9 and *P in Fig. 5. That selection is carried out with 

the AT- compatible computer 20, or other suitable com- 
5 puter, by inputting data for 0 and < P. 

It should be apparent that this method can be used to 
make sound recordings in various media such as CD's, tapes 
and digitized sound recordings, in which non-directional 
sounds are converted to directional sounds by inputting 

10 various sets of values for 9 and <P. With a series of vary- 
ing values, the sound can be made to "move" relative to 
the listener's ears, hence, the terms "three-dimensional" 
sound and "virtual auditory environment" are applied to 
describe this effect. 

15 This description has been by way of example of how 

the invention can be carried out. Those of ordinary skill 
in the art will recognize that various details may be mod- 
ified in arriving at other detailed embodiments, and that 
many of these embodiments will come within the scope of 

20 the invention. Therefore to apprise the public of the 

scope of the invention and the embodiments covered by the 
invention the following claims are made. 
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We claim: 

1. A method of sound playback in which a sound is to 
be produced as if originating from a selected direction in 
space relative to a listener's ear, the method comprising 
the steps of: 

storing a recorded audio signal representing a sound 
to be played back; 

converting the recorded audio signal to at least one 
filtered component; 

adjusting the filtered component as a function of the 
selected direction in space from which the direction of 
the sound is to be simulated upon play back; 

generating a resultant audio signal in response to 
the adjusted, filtered component; 

converting the audio signal to a sound observed by a 
listener to have originated at the selected direction in 
space relative to the listener's ear. 



2. The method of claim 1, wherein 

the adjusting step is performed in response to pre- 
measured data for a plurality of directions in space; and 

and further comprising the step of applying a spline 
function to the premeasured data, 

and the step of interpolating results from the spline 
function operation corresponding to directions in space 
which are in between directions in space for the premea- 
sured data. 
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3. The method of claim 1, wherein 

during the converting step the recorded audio signal 
is converted to a plurality of filtered components; 

wherein the adjusting step is performed for the plu- 
5 rality of filtered components; and 

further comprising the step of summing the resulting 
adjusted filtered components and generating a resultant 
audio signal. 



4. The method of claim 3, wherein 

the adjusting step is performed in response to pre- 
measured data for a plurality of directions in space; and 

and further comprising the step of applying a spline 
5 function to the premeasured data, 

and the step of interpolating results from the spline 
function operation corresponding to directions in space 
which are in between directions in space for the premea- 
sured data. 
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5. Apparatus for playback of sound, wherein a sound 
is to be produced as if originating at a selected direc- 
tion in space relative to a listener's ear, the apparatus 
comprising: 

5 means for storing an audio signal representing a 

sound to be played back; 

means for converting the audio signal to a plurality 
of filtered components based on premeasured data for a 
sound detected within an ear; 
10 means for adjusting each filtered component as a 

function of the selected direction in space from which the 
direction of the sound is to be simulated upon playback; 

means for summing the resulting adjusted, filtered 
components of the sound to be played back and generating a 
15 resultant audio signal; 

means for converting the audio signal to a sound ob- 
served by a listener to have originated at the selected 
direction in space relative to the listener's ear. 



6. A method for recording a sound to be played back 
as if originating at a selected direction in space rela- 
tive to a listener's ear, the method comprising: 

receiving and storing an audio signal representing a 
5 sound to be played back; 

converting the recorded audio signal to at least one 
filtered component; 

adjusting the filtered component as a function of the 
selected direction in space from which the direction of 
10 the sound is to be simulated upon play back; and 

storing the the adjusted filtered component in a 
recording medium for playback. 
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7. The method of claim 6, wherein 

the adjusting step is performed in response to pre- 
measured data for a plurality of directions in space; and 

and further comprising the step of applying a spline 
function to the premeasured data, 

and the step of interpolating results from the spline 
function operation corresponding to directions in space 
which are in between directions in space for the premea- 
sured data. 



8* The method of claim 6, wherein 

during the converting step the recorded audio signal 
is converted to a plurality of filtered components; 

wherein the adjusting step is performed for the plu- 
rality of filtered components; and 

further comprising the step of summing the resulting 
adjusted filtered components and generating a resultant 
audio signal. 



9. The method, of claim 8, wherein 

the adjusting step is performed in response to pre- 
measured data for a plurality of directions in space; and 

and further comprising the step of applying a spline 
function to the premeasured data, 

and the step of interpolating results from the spline 
function operation corresponding to directions in space 
which are in between directions in space for the premea- 
sured data. 



WO 94/10816 




t 1 

PCT/US93/G1840. 



10. A sound recording made according to a method in- 
cluding the steps of: 

receiving and storing an audio signal representing a 
sound to be played back; 
5 converting the recorded audio signal to at least one 

filtered component; 

adjusting the filtered component as a function of the 
selected direction in space from which the direction of 
the sound is to be simulated upon play back; and 
10 storing the the adjusted filtered component in a 

recording medium for playback. 



11. The method of claim 10, wherein 

the adjusting step is performed in response to pre- 
measured data for a plurality of directions in space; and 

and further comprising the step of applying a spline 
5 function to the premeasured data, 

and the step of interpolating results from the spline 
function operation corresponding to directions in space 
which are in between directions in space for the premea- 
sured data. 



12. The method of claim 10, wherein 

during the converting step the recorded audio signal 
is converted to a plurality of filtered components; 

wherein the adjusting step is performed for the plu- 
5 rality of filtered components; and 

further comprising the step of summing the resulting 
adjusted filtered components and generating a resultant 
audio signal. 
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13. The method of claim 12, wherein 



the adjusting step is performed in response to pre- 



measured data for a plurality of directions in space; and 
and further comprising the step of applying a spline 



5 function to the premeasured data, 

and the step of interpolating results from the spline 
function operation corresponding to directions in space 
which are in between directions in space for the premea- 
sured data. 
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